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Abstract 

Multi-leader multi-follower games are a class of hierarchical games in which a collection of leaders 
compete in a Nash game constrained by the equilibrium conditions of another Nash game amongst 
the followers. The resulting equilibrium problems are complicated by nonconvex agent problems and 
therefore providing tractable conditions for existence of global or even local equilibria has proved 
challenging. Consequently, much of the extant research on this topic is either model specific or 
relies on weaker notions of equilibria. In the first part of the paper, we provide what is perhaps 
the first general existence to such games. Our central idea is to relate the global minima of certain 
optimization problems to equilibria of these games. We show that if the objectives of the leaders admit 
a quasi-potential function, one can construct an optimization problem (a mathematical program with 
equilibrium constraints (MPEC)) whose global minimum is an equilibrium of the game. In effect 
existence of equilibria can be guaranteed by the solvability of an optimization problem, which holds 
under mild conditions. 

We then consider a modified formulation in which every leader is cognizant of the equilibrium 
constraints of all leaders, leading to a shared constraint game. This modification allows for more 
general objectives functions and it is shown that when the leader objectives admit a potential func- 
tion, the global minima of an optimization problem where the potential function is minimized over 
the shared constraint, are equilibria of the modified multi-leader multi-follower game. Importantly, 
equilibria of this modified game contain the equilibria, if any, of the original game. 

In both instances, local minima and B-stationary points of the associated optimization problem 
are shown to be local Nash equilibria and Nash B-stationary points of the corresponding multi-leader 
multi-follower game. We note through several examples that such potential multi-leader multi- 
follower games capture a breadth of application problems of interest. We demonstrate these findings 
on a multi-leader multi-follower Cournot game. 

1 Introduction 

Contemporary market models in imperfectly competitive regimes are complicated by the need to capture 
the rationality of a participant to the fullest extent possible. For instance, power markets are often 
characterized by a sequence of clearings, such as in the day-ahead and real-time markets. Consequently, 
models of these strategic interactions require a firm to be modeled as not just strategic with respect to its 
rivals but also as cognizant of the real-time market clearing to follow [44, 43, 38]. Similarly, generation 
firms participating in a transmission-constrained power market are often modeled as being leaders with 
respect to the transmission provider that sets transmission prices [6, 20]. Common to both models is 
a hierarchical structure in which a set of participants, designated leaders, participate in a Nash game 
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subject to the equilibrium amongst another set of participants called followers. The resulting game is 
referred to as a multi-leader multi-follower game. The equilibrium amongst the followers is compactly 
captured by an equilibrium constraint in the optimization problem of a leader, whereby each leader faces 
a mathematical program with equilibrium constraints, or an MPEC [27]. The equilibrium amongst 
leaders is captured by a problem popularly referred to as an equilibrium program with equilibrium 
constraints (EPEC) and its associated equilibria, if any, are of interest. 

In the context of general EPECs, the present state of knowledge may be summarized as follows. 
There are several instances of EPECs for which equilibria have been shown to exist, but there are also 
fairly simple EPECs which admit no equilibria [33]. Definitive statements on the existence of equilibria 
have been obtained mainly for multi-leader multi-follower games with specific structure [39, 40, 43] 
and for models arising from specific applications, e.g. those in the power industry [7, 29]. In the 
majority of these settings, the uniqueness of the follower-level equilibrium is leveraged to construct 
an implicit problem which, due to the structure of the problem, allows for the application of standard 
fixed-point theorems. On another track, existence has been claimed for weaker notions of equilibria, 
e.g., solutions of the aggregated stationarity conditions of the problems of the leaders [21, 38, 31]. A 
similar approach for deriving existence statements for games with regularized equilibrium constraints 
was examined by Pang and Scutari [32]. The complementarity conditions have also been the basis of 
constructing computational approaches [26, 42, 38]. These results and models are surveyed in greater 
detail in Section 2.1. 

At the heart of this absence of general global existence results lies the fact that a mathematical 
principle, on which the existence of an equilibrium of an EPEC may rest, is not known. In conventional 
convex Nash games, such principles are well known - the fixed point theorems of Brouwer and Kakutani 
(see [12, 4]). Indeed when the feasible region of the EPEC is convex and compact, the multi-leader 
multi-follower game can be thought of as a conventional Nash game or a generalized Nash game and 
the existence of a global equilibrium follows from classical results. But the equilibrium constraint in 
an EPEC is notorious for being nonconvex and for lacking the continuity properties required to apply 
fixed point theory. Consequently, most standard approaches fail to apply to EPECs and there currently 
exists no general mathematical paradigm that could be built upon to make a theory for general EPECs. 

Our interest is in problems where the implicit form and the associated structure cannot be directly 
leveraged to develop a tractable (implicit) problem in leader decisions. Furthermore, our focus is on 
developing sufficiency conditions for the existence of global equilibria, rather than on guaranteeing that 
the concatenated stationarity conditions admit solutions, although our approach also provides results 
of the latter flavor. This paper rests on the following central idea: we relate the minimizer of an 
optimization problem to the equilibrium of the game, thereby obviating the need to apply fixed point 
theory. Our main contributions can be summarized as follows: 

(1) Quasi-potential games: First, we introduce a new class of multi-leader multi-follower games, 
called quasi-potential games, in which the leaders' objectives take on a particular structure, part of 
which admits a potential function. In the context of such games, we show that the global equilibria of 
such games are given by the global minimizers of suitably defined optimization problem. Notably, such 
relationships also extend to local Nash equilibria and B-stationary equilibria. Importantly, in all of these 
instances, existence of equilibria follows directly from making compactness or coercivity assumptions 
on the associated MPEC, all of which are verifiable in nature. 

(2) Shared constraint modifications: Second, we present a modified formulation of multi-leader 
multi-follower competition that admits a shared constraint structure. In a game with shared constraints, 
there exists a common constraint that constrains each player's optimization problem [35, 9, 24]. In fact, 
the equilibria of this game contain the equilibria of the unmodified game, if indeed the original game 
admits equilibria. We show that if the leader objectives admit a potential function, then any minimizer 
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of the potential function over a shared constraint is an equilibrium of the modified game. Additionally, 
we show that local minimizers and B-stationary points of this MPEC are local Nash equilibria and Nash 
B-stationary points of the modified game. 

All of our existence statements rely on the solvability of an optimization problem and as such can 
be claimed despite the analytical challenges imposed by nonconvexity and without invoking continuity 
properties. Furthermore, in each case local minimizers of the optimization problem are local equilibria of 
this multi-leader multi-follower game. The shared constraint model can be viewed as an alternative, and 
a better posed, model or can be seen as a vehicle for developing existence statements for the unmodified 
game. 

The remainder of the paper is organized into five sections. In Section 2, we survey multi-leader multi- 
follower games studied in practice, provide some background and comment on what makes conventional 
formulations of multi-leader multi-follower games intractable. We provide existence statements for quasi- 
potential games in Section 3. In Section 4 we present modifications that lead to a shared constraint game 
and present existence results for them. We apply our techniques towards the analysis of a hierarchical 
Cournot game in Section 5 and the paper concludes in Section 6 with a brief summary. 

2 Multi-leader multi-follower games: examples and background 

Multi-leader multi-follower games assume relevance when modeling hierarchical competitive interactions. 
In Section 2.1, we initiate our discussion through several examples considered in literature with the intent 
of noting that in a majority of these instances, the associated objective functions of the leaders admit 
a potential function, thereby also noting the utility of this class in practice. A general formulation 
for such games and the associated equilibrium problem is provided in Section 2.2. In Section 2.3, we 
conclude this section with a brief commentary on the challenge in applying standard approaches. 

2.1 Examples of multi-leader multi- follower games 

The multi-leader multi-follower game is inspired by a strategic game in economic theory referred to as 
a Stackelberg game [41]. In such a game, the leader is aware of the follower's reaction and employs that 
knowledge in making a first move. The follower observes this move and responds as per its optimization 
problem. An extension to this regime was provided by Sherali et al. [40] where a set of followers compete 
in a Cournot game while a leader makes a decision constrained by the equilibrium of this game. While 
multi-leader generalizations were touched upon by Okuguchi [30], Sherali [39] presented amongst the 
first models for multi-leader multi-follower games in a Cournot regime. A majority of multi-leader 
multi- follower game-theoretic models appear to fall into three broad categories. We provide a short 
description of the games arising in each category: 

Hierarchical Cournot games: In a hierarchical Cournot game, leaders compete in a Cournot game 
and are constrained by the reactions of a set of followers that also compete in a Cournot game. We 
discuss a setting comprising of N leaders and M followers, akin to that proposed by Sherali [39]. 
Suppose the i th leader's decision is denoted by Xi and the follower strategies conjectured by leader i 
are collectively denoted by {yf }fLi where / denotes the follower index. Given the leaders' decisions, 
follower / participates in a Cournot game in which it solves the following parametrized problem: 



F(y~f,x) 


minimize 

yf 

subject to 




-y f p (y + z)) 




y/>o, 
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where p(.) denotes the price function associated with the follower Cournot game, ^Cf(y^) 2 denotes firm 
/'s quadratic cost of production, x = X^ x «> V — J2fV^ an d — Ylj^fW*- Leader % solves the 
following parametrized problem: 

Li(x~\ y~ % ) minimize \dix\ - Xip (x + &)) 

sublectto y{ = SOL(F(y7f, Xi , x -% V /, 



where y{ € 1R is leader i's conjecture of follower /'s equilibrium strategy, yi = {y( }jLi, \dix\ denotes 
the quadratic cost of production of leader i, x~ % = {xj}j^i and y~ % = {yj}^ * =1 . The equilibrium of the 
resulting multi-leader multi-follower is given by {(xi 7 yi)}f =l where (xi,yi) is a solution of Lj(x~*,y~*) 
for i = 1, . . . , N . In this regime, under identical leader costs, Sherali [39] proved the existence and 
uniqueness of the associated equilibrium. More recently, DeMiguel and Xu [7] extended this result to 
stochastic regimes wherein the price function is uncertain and the leaders solve expected- value problems. 

Spot-forward markets: Motivated by the need to investigate the role of forward transactions in 
power markets, there has been much interest in strategic models where firms compete in the forward 
market subject to equilibrium in the real-time market. Allaz and Vila [1] examined a forward market 
comprising of two identical Cournot firms and demonstrated that global equilibria exist in such mar- 
kets. Furthermore, it was shown that the presence of such a market leads to improved market efficiency. 
Motivated by the possibly beneficial impacts of forward markets on consumer welfare (cf. [16, 22]), such 
models have gained increasing importance in the examination of strategic behavior in power markets 
which are generally characterized by a sequence of clearings in the forward, day-ahead and real-time 
markets. The result of Allaz and Vila hinges on the assumption that the follower problems are quadratic 
programs and follower reactions satisfy inequality constraints strictly; consequently, the follower reac- 
tions reduce to linear equality constraints. Su [43] extended these existence statements to a multi-player 
regime where firms need not have identical costs. In such an iV-player setting, given the forward deci- 
sions of the players {xi}fL l , firm i solves the following parametrized problem in spot-market: 



S(z-\x) 


minimize qzj — p (z) (zi — xA 




subject to Zi > 0, 



yij is the where CjZj is the linear cost of producing Zi units in the spot-market, z = Y2j z j an d p(-) is the 
price function in the spot-market. In the forward market, firm i's objective is given by its overall profit, 
which is given by —p^Xi — p(y~i)(yi,i — xi) + Cjy^j, where pf denotes the price in the forward market yij 
is the anticipated equilibrium production by leader j and y~i = ^2jVi,j- By imposing the no-arbitrage 
constraint that requires that pf = p(y~i), the forward market objective reduces to c%ya — p(yi)yi,i- Firm 
i's problem in the forward market is given by the following: 

L(x~ l ) minimize Ciy iti - p(y~i)yi,i 

subject to y 4j G SOL(S(j/r J ,x i ,x- i )), V j. 

Note that while the spot-forward market problem is closely related to the hierarchical Cournot game, it 
has two key distinctions. First, leader i's cost is a function of forward and spot decisions. Second, every 
leader's revenue includes the revenue from the second-level spot-market sales. As a consequence, the 
problem cannot be reduced to the hierarchical Cournot game, as observed by Su [43]. In related work, 
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Shanbhag, Infanger and Glynn [38] conclude the existence of local equilibria in a regime where each firm 
employs a conjecture of the forward price function. Finally, in a constrained variant of the spot-forward 
game examined by Allaz and Vila, Murphy and Smeers [29] prove the existence of global equilibria when 
firm capacities are endogenously determined by trading on a capacity market and further discover that 
Allaz and Vila's conclusions regarding the benefits of forward markets may not necessarily hold. In 
electricity markets, there has been work beyond the papers mentioned above, in particular, by Henrion, 
Outrata, and Surowiec [19] and Escobar and Jofre [8]. 



Congestion control in communication networks: Significal effort has been applied towards the 
analysis of multi-user communication. Suppose J\f = {l,...,iV} denotes the set of users and K = 
{Ki, . . . , Kn} represents the set of the user-specific strategy sets are denoted by K±, . . . , Kpj. Given a 
set of user-specific flow decisions, collectively captured by x, the network manager solves a parametrized 
optimization problem given by the following: 



Network(x) 



minimize f(y',x) 
y 

subject to y € C(x), 



in which y represents the network decisions (which include flow specifications etc.), f(y;x) denotes the 
network manager's objective f(y;x), and C(x) represents the set of feasible allocations available to the 
manager, given x. Each user is assumed to be a leader with respect to the network manager (follower) 
and the resulting user problem is given by the following: 



Ag(x 



maximize 
subject to 



Ui(xi) - h(y) 
Xi G Ki 

y G SOL(Network(x)), 



where h{y) represents the congestion cost associated with the network manager's decision y. We assume 
that every user is charged the entire cost of congestion, an assumption that is standard in such mdoels 
(cf. [2, 5]). Such a model represents a hierarchical generalization of the competitive model considered 
by Ba§ar [5], Alpcan and Basar [2], and Yin, Shanbhag, and Mehta [45]. Notably, past work has not 
modeled the network manager as a separate entity but this extension has much relevance when consid- 
ering the role of large, and possibly strategic, independent system providers (ISPs) in the context of 
network management. 



We conclude this section with two observations. First, almost all of the existence results are model- 
specific and are not more generally applicable to the class of multi-leader multi-follower games. Second, 
in all of the instances surveyed above, the leader objectives admit a potential function. For instance, 
in hierarchical Cournot games, if the associated price functions are affine, then the resulting game is a 
potential multi-leader multi- follower game (cf. [28]). In the spot-forward games, the leader's objectives 
are dependent only on follower decisions; consequently, the payoffs are independent of competitive 
decisions and this can be immediately seen to be a potential multi-leader multi-follower game. 
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2.2 Conventional formulation of multi-leader multi-follower games 



Let J\f = {1, 2, ... , iV} denote the set of leaders. In the usual formulation of multi-leader multi-follower 
games, leader i G M solves a parametrized MPEC of the following kind. 





minimize 
















subject to 


Vi G Yi, 






Vi G SOL(G(xi,x-\-),K( Xl ,x- 1 )). 



Here X{ G R mi denotes leader i's strategy and we have used the usual notation 

x~ % = (xx, . . .,Xi-i,x i+ i,. . .,x N ) and (xi,x~ l ) = (xi, . . . , x t , x i+1 , 



,XN) 



Furthermore, yi denotes the tuple of strategies of all followers with the requirement that yi be an 
equilibrium of the Nash game amongst the followers. Note that this Nash game is parametrized by the 
tuple of leader strategies x = (xi, . . . ,xn). For each x, the set of follower equilibria are the solutions 
of the variational inequality (VI), VI(G(x, -),K(x)), and are denoted as SOL(G(xi, x _l , •), K(xi, x~ % )). 
Henceforth we abbreviate 

S{x) 4 SOL(G(xi, x~\ ■), K( Xi , x-% (1) 

We assume that the set-valued map K is continuous as a set-valued map and G is a continous mapping 
of all variables. 

Though yi is not strictly within leader z's control, a minimization over yi is performed by a leader 
who is assumed to be optimistic; a pessimistic leader would maximize over yi while minimizing over Xj. 
The sets Xi and Yi represent other constraints and are assumed to be closed convex sets. For each i, 



objective function ipi is defined over X xY, where X = YiiLi Xi and Y = YliLi Yi and assumed to be 



continuous. Let y = (yi, . . . , t/jy) an d £li(x z ,y 



-i\ A 



be the feasible region of Lj(x~%y~*), given by 

eX h 



X i 

Vi G Yi, 
Vi G S(x) 



(2) 



where R n is the ambient space of the tuple (x, y). Notice that, Oj(x - *, y~ l ) is in fact independent of y~ l . 
However we use this notation to maintain consistency with other notation we introduce in the context 
of shared constraints. Let £l(x,y) denote the Cartesian product of Vti{x~ l ,y~ l ) : 



N 



i=l 

An important object in our analysis is the set J- defined as 

{ (x,y) GR" 



y 



(3) 



Vi G Y u 
Vi G5(x), 



(4) 



1. 



,N 



which is the set of tuples (x, y) such that (xi, yi) is feasible for Lj(x - \ y~ l ) for all i. It is easily seen that 
T is the set of fixed points of Q, i.e. T = {(x,y) G R n : (x,y) G Q(x,y)}. We refer to £1 as the feasible 
region mapping and denote the EPEC associated with this multi-leader multi- follower game by S . 
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Definition 2.1 (Global Nash equilibrium) Consider the multi-leader multi-follower game S . The 
global Nash equilibrium, or simply equilibrium, of S is a "point (x, y) G J- that satisfies the following: 

ifiixiiy^x" 1 ) < Lpi(ui,Vi]x~ l ) V(ui,Vi) G VLi{x~\y~ % ), i = l,...,N. (5) 

Eq (5) says that at an equilibrium (x,y), (xi,yi) lies in the set of best responses to (x~ l ,y~ l ) for all i. 
The qualification "global" is useful in distinguishing the equilibrium from its stationary counterparts 
(referred to as a "Nash B-stationary" , "Nash strong-stationary", etc.) or its local counterpart (referred 
to as a "local Nash equilibrium"). In this paper, our main focus is on global Nash equilibria and we 
refer to them as simply "equilibria"; other notions are qualified accordingly. 



2.3 Intractability of the conventional formulation 



At the Nash equilibrium, each player's strategy is his "best response" assuming the strategies of his 
opponents are held fixed. For any tuple of strategies z = (z±, . . . , zn), one may define a reaction map 
(set-valued in general) as 



/v 



K(z) :=n^ 



i=i 



where lZi{z~ l ) is the solution set of player i's optimization problem obtained from assuming the oppo- 
nent's strategies fixed at z~ % . The Nash equilibrium is a fixed point of this map. When the feasible 
region of each player's optimization problem is convex and independent of his opponent's strategies, 
and each player's objective function is convex in his own strategy, 7Z is upper semicontinuous and 
convex-valued. Thus if the space of strategies of players, which forms the domain of 7Z, is also compact, 
Kakutani's fixed point theorem yields the existence of a Nash equilibrium. 

Due to the nonconvexity of problems {Lj}j g ^/- there appears to be no simpler characterization of an 
equilibrium of the game <§ than through the fixed-point of its reaction map. However, difficulties arise 
when one attempts to apply fixed point theory to this reaction map. For game £ the reaction map is a 
map Tl : dom(O) -> 2 ran § c ( n ), where 



K{x,y) = { 



(x,y) G £l{x,y) 



V (u,v) en(x,y)\ . (6) 



<Pn(xn,Vn;x n ) < tp N (u N ,v N ;x N ) 



Almost all fixed point theorems rely on the following broad assumptions: 



(a) the mapping to which a fixed point is sought is assumed to be a self-mapping; 

(b) (i) the domain of the mapping and (ii) the images are required to be of a specific shape, e.g. 
convex; 

(c) the mapping is required to be continuous (if the mapping is single- valued) or upper semicontinuous 
(if set-valued). 

The first difficulty encountered is that 7Z is not necessarily a self-mapping: 1Z maps dom(r2) to range(fi) 
and range(O) may not be a subset of dom(f2). Second, dom(f2) is hard to characterize and little can 
be said about its shape. Finally, the continuity (or upper semicontinuity) of 1Z is far from immediate. 
There are ways of circumventing difficulties (a) and (b), some of which have been employed in literature. 
If U(x, y) ^ for all (x, y) G X x Y, we have dom(fi) = X xY and 1Z may be taken to be a map from 
X x Y to subsets of X x Y. This approach was employed by Arrow and Debreu [3]. If X x Y is convex, 
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as is in our case, the difficulty (b(i)) is also circumvented. The (upper semi-) continuity of 1Z requires 
ft to be continuous [11], a property that rarely holds if S (the solution set of a VI) is multivalued. As 
a consequence, the shape of the mapped values ((b.ii)) and the upper semicontinuity of 1Z are the key 
barriers to the success of this approach. In the case where S is single- valued, the continuity of 1Z follows 
readily. A majority of the known results for EPECs are indeed for this case. 

3 Quasi-potential multi-leader mult i- follower games 

In this section, we consider a class of multi-leader multi-follower Nash games with the goal of developing 
sufficient conditions for the existence of equilibria. In Section 3.1, we define a new class of multi- leader 
multi-follower games, called quasi-potential games, and provide conditions for the existence of global 
equilibria. Analogous results for local and Nash stationary equilibria are provided in Section 3.2. Finally, 
in Section 3.3 we conclude by commenting on how the results apply to some well-known examples. 

3.1 Existence results for global equilibria 

To motivate quasi-potential games, let us first consider potential games. Consider the multi-leader 
multi-follower game $ introduced earlier. 

Definition 3.1 (Potential multi-leader multi-follower games) A potential multi-leader multi-follower 
game is a multi-leader multi-follower game where leaders have objective functions ipi,i G N such 
that there exists a function ir, called potential function, such that for all i G M, for all (xi,x~ l ) G 
X, (yi, y~ l ) G Y and for all x\ G X is y[ G Y t 

ipi(xi,yi;x~ l ,y~ % ) - ^(x-, y-; x~\ y~ l ) = n(xi, yf, x~\ y~ l ) - vr(x-, y[\ x~\ y~ l ). (7) 

One may ask if it is true that potential multi-leader multi-follower games have equilibria? The 
answer is no, as demonstrated by an example of Pang and Fukushima [33] (we consider this example in 
Section 3.3 and revisit it in 4.1). Next let us consider the case where for each tuple of leader decisions, 
there is a unique follower equilibrium. In this case, the leader problem Lj can be reformulated as follows: 





minimize 


Pi(xi,S(x);x l ) 




subject to 





where S(x) is defined in (1) as the set of follower equilibria induced by x. Denote this game as S . We 
may now define an implicit potential multi-leader multi-follower game as follows. 

Definition 3.2 (Implicit Potential multi-leader multi-follower games) An implicit potential multi- 
leader multi-follower game is a multi-leader multi-follower game in which the i th leader solves Li(x~ l ) 
and there exists a function ir, referred to as a potential function, such that for all i G N , for all 
(xi, x~ l ) G X, and for all x\ G Xi 

ipi(xi,S(x);x-' 1 ) - ip i [x' i ,S{x' i ,x- l )\x- % ) = tt(x;, S(x); x~ l ) - tt(:e-, <S(x-, x~ l ); x~ l ). (8) 

For an implicit potential multi-leader multi-follower game, we derive an existence statement by relating 
it to an associated optimization problem: 



pimp 


minimize 

X 


ir(x) 




subject to 


x £ X. 
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The following proposition formalizes the relationship between the global minimizers of the above problem 
and the global equilibria of a potential multi-leader multi-follower game. 

Proposition 3.1 Consider an implicit potential multi-leader multi-follower game $ . Then any global 
minimizer of P imp is a global Nash equilibrium of £ '. 

Proof : Let x be a global minimizer of p im P. Then clearly, 

tt(x) < tt(x') Vx' G X. 

Fix i E M, let Xj G Xj be arbitrary and let x' := (x^, x~ l ). Since X = J} JQ, the point x' G X. Now (8) 
gives that 

ifi(xi,y(x);x~ l ) < (pi(xi,y(xi,x~ l );x~ l ). 
Since Xj and i £ AT were arbitrary, it follows that x is an equilibrium ■ 

In principle, the above is an existence result. However two challenges emerge when one considers the 
result in practice. First, in most cases, particularly when the second-level equilibrium constraints arises 
from the equilibrium conditions of a constrained problem, iS(-) is not single- valued. Second, even if S(-) 
is single- valued, ascertaining the potentiality of this implicit game is hard. Evidently, this ascertaining 
potentiality would require one to have a closed- form expression for «S(-). We now provide a different 
avenue that relies on defining a related, but distinct, property of quasi-potentiality. 

Definition 3.3 (Quasi-potential multi-leader multi-follower games) Consider a multi-leader multi- 
follower game <§ in which the player objectives are denoted by {(pi, ■ ■ ■ , Pn} &nd assume that Y\ = . . . = 
Y/V = Y . £ is referred to as a quasi-potential game if the following hold: 

(i) Fori = 1,...,N, there exist functions </>i(x), . . . , 0j\r(x) and a function h(x,yi) such that each 
player i's objective ipi(-) is given as 

(Pi(xi,yi; x~ l ) = <pi(x) + h(x, y { ). 

(ii) There exists a function ir(-) such that for all i = 1, . . . , N, and for all x G X and x\ G X{, we have 

<pi(xi; x~ l ) - (j) i (x' i \x~' 1 ) = Tr(xi]x~ l ) - 7r(x-;x~ J ). 

The function tt + h is called the quasi-potential function. 

Notice that we have assumed Yi = Y for all i and the function h does not have a subscript l i\ and is 
thereby the same for all players. Essentially a quasi-potential game has objective functions which can 
be a written as a sum of an 'x' part and an l x, part, wherein the 'x' part admits a potential function 
in the standard sense and the 'x, yi part is identical for all players. There exists a function tt as required 
in Definition 3.3 if and only if [28] (see also Lemma 4.2) for all x G YiiLi %i 

V Xi n(x) = V Xi </)i(x) Vi G M. (9) 

Consider the optimization problem pi 113 - 8 ^ defined as: 



p quasi 


minimize 


7r(x) + h(x, w) 




x,w 




subject to 


(x, w) G J" quasi 
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where 



^•quasi 



(x, w) G R n 



w £7 
w G S{x) 



1 N 



(10) 



Observe that J 7 'i uasi is a closed set: the constraint w G is equivalent to a nonlinear equation 

F nat (w;x)=0, 

where F nat (-; x) is the natural map of VI(G(x, ■), if (x)). Since if, G have been assumed continuous (cf. 
immediately following (1)), it follows that the zeros of F nat form a closed set. 

Our main result relates the minimizers of pi 11 ^ 1 to the global equilibria of £ '. In deriving this 
result we exploit the fact that £li(x~ l , y~ l ) is in fact independent of y~ % (recall the discussion following 
(2)). Likewise, does not depend on y~ % . Therefore in this section we explicitly use the notation 
£li{x~ l ) = Qi(x~\y~ l ) and L i (x" i ,y~') ee L^x' 1 ). 

Proposition 3.2 Consider a quasi-potential multi-leader multi-follower game £. Then if (x,w) is a 
global minimizer o/P quasi , then (x,y), where y% = w for all i G TV, is a global equilibrium of £ '. 

Proof : Observe that a point (xi,w) is feasible for the i th agent's problem Lj(x - *) if and only if 
(x,w) G 7" quasi . i.e., 

( Xi ,w) g OiOO (11) 
Now suppose, (x,w) is a solution of p^ uasl . Then, 

7r(x) + h(x, w) < tt(x') + h(x , it/), Mx 1 G X and w' G S(x'). 

More specifically, taking x' = (x^,x _l ) and w' G S(x' i , x~ l ), and using (11), it follows that 

7r(xi; x-i) + h(x, w) < 7r(x-; x-i) + /i((x-, x_j), w') V(x-, w') G Q.i{x~ l ). 

Since £ is a quasi-potential game, ir(xi,x-i) — 7r(x^, X-j) = (f>i(xf, x-i) — ^(x'^x-i). Let y be such that 
yi = w for all i G M. As a result 

ipi(xi,yi;x~ z ) < tfiix'i, w';x~ l ), Vx'^w' G Qi(x~ l ), 

and hence (xi,yi) is a solution Lj(x - *). The result follows. ■ 

Given this relationship between the minimizers of p ^ 1 and the equilibria of £, existence of equilibria 
is guaranteed by the solvability of pi" 1181 , as formalized by the next result. 

Theorem 3.3 (Existence of global equilibria of £) Let £ be a quasi-potential multi-leader multi- 
follower game. Suppose J 71 ?^ 1 is a nonempty set and ipi is a continuous function for i = 1, . . . , N . If 
the minimizer of ~pi uasi exists (for example, if either ir is a coercive function over J 7 ^^ 1 or if J rt i uasi is 
compact), then £ admits an equilibrium. 

We now consider a special case of £ which is a quasi-potential multi-leader multi-follower game. 
Here the i th leader solves the following problem wherein the objective is independent of yi and refer to 
this problem as £ md . 



L? d (x-\y- 1 ) 


minimize 














subject to 


Vi e Y, 






Hi G <S(x). 
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The following corollary captures the relationship between the global minimizers of pq uasi and the global 
equilibria of $ mA . 

Corollary 3.4 Consider game <f md in which for each i, ipi(xi,yf, x~ l ) = (pi(xi,x~ l ) and the functions 
{VilieAA admit a potential function. Then this game is a quasi-potential multi-leader multi-follower 
game and if (x,w) is a global minimizer jpq uasi ? then (x,y) where y$ = w for all i G N is a global 
equilibrium of (^ md . If a solution exists to pq uasi ; %% is a global equilibrium o/<f md . 

At this juncture, it is worth differentiating the above existence statements from more standard results 
presented in [39, 43] where the follower equilibrium decisions are eliminated by leveraging the single- 
valuedness of the solution set of the follower equilibrium problem. In these approaches, the final claim 
rests on showing that the "implicitly" defined objective function is convex and continuous, properties 
that again require further assumption. In comparison, we do not impose any such requirement. Finally, 
we believe that the class of quasi-potential games is not an artificial construct. For instance, the 
congestion control games arising in communication networks clearly lead to a quasi-potential multi- 
leader multi-follower game. 

3.2 Local and Nash stationary equilibria 

While the discussion thus far provides an approach for claiming existence of global equilibria by obtaining 
a global solution to a suitable optimization problem. However, the computation of a global minimizer 
of p<5 uasi is a difficult nonconvex problem that falls within the category of mathematical programs with 
equilibrium constraints (MPEC). However, one can often obtain stationary points or local minimizers of 
such problems and in this subsection, we relate these points to analogous local or stationarity variants 
of Nash equilibria. We begin with a formal definition of a Nash Bouligand stationary or a Nash B- 
stationary point. 1 

Definition 3.4 (Nash B-stationary point) A point (x,y) G F is a Nash B-stationary point of $ if 
for all i G M , 

Vwi{x,y) T d > yd e Tiix^yi)-^- 1 )), 

where T(z; K), the tangent cone at z G K C IR n , is defined as follows: 

T(z; K) = \ dz G K" : 3{r fc }, {z k } such that dz = lim ( Z J—L ) j k 3 z k -> z, < T k -> I . 

I fc^oo \ T k J J 

Proposition 3.5 (Nash B-stationary points of <f) Consider a quasi-potential multi-leader multi- 
follower game $ and suppose ipi is a continuously differentiable function over X{ x Y for i = 1, . . . , N . 
If (x, w) is a B-stationary point o/P quasi , then (x, y) where yi = w for all i £ N is a Nash B-stationary 
point of & '. 

Proof : A stationary point (x, w) of pi" 3 - 81 satisfies 

V x (tt(x) + h(x, w)) T dx + V w h(x, w) T dw > 0, V(ds, dw) G T({x, w);^ 33 ' 1 ). (12) 
Fix an i G Af and consider an arbitrary (dx^, dy^) G T(xi,w; f2j(x~*)). By the definition of the tangent 

k k 

cone, there exists a sequence £l{x~ % ) 3 (ui jk ,Vi jk ) -3- (xi,w) and a sequence < r k — > such that 
Ul ' k ~ Xl A dx\ and Vl ' k T ~ w A dy[. It follows that the sequence (xj^, y i fc ), where 

*i,k = (xi, ■ ■ ■ ,Ui,k, ■ ■ -,xn), and y ik = v i>k , (13) 
A primal-dual characterization of B-stationarity is provided by Pang and Fukushima [34]. 
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satisfies (x^y^) G J rc i uasi . Therefore, the direction (dXj,dw) where 

dxj = (0, . . . , dx' i: . . . , 0) and dj^ = dy' i: 

belongs to T((x, w); J" c i uasi ). Substituting (dx,dw) = (dx^dyj in (12) and using (9) gives 

V Xi ((pi(x) + h(x, w)) 1 dx'i + V w h(x, w) 1 dy[ > 0. 

Since, i G TV and (dx^dy^) G T(xi,w; £li(x~ 1 )) were arbitrary, (x, w) is a Nash B-stationary point of S. 
■ 

We now define a local Nash equilibrium and show its relationship to the local minimum of p^ 3 - 81 . 

Definition 3.5 (Local Nash equilibrium) A point (x,y) G T is a local Nash equilibrium of $ if for 

all i G M , (xi,yi) is a local minimum of Lj(x _l ) . 

Proposition 3.6 (Local Nash equilibrium of S) Consider a quasi-potential multi-leader multi-follower 
game £ and suppose (fi is continuously differentiable function over Xi x Y for i = 1, . . . , N . If (x,w) 
is a local minimizer o/P quasi , then (x,y), where y = (w, . . . ,w) is a local Nash equilibrium of £ . 

Proof : If (x, w) is a local minimum of p c i uasi ) there exists a neighborhood of (x, w), denoted by B(x, w), 
such that 

ir(x) + h(x,w) < ir(x') + h(x',w'), V(i>')eB(i,ii))n^™. (14) 

Consider an arbitrary i G M and let Bi(xi,w;x~ l ) := {(ui,Vi) \(ui, x~ % ,Vi) G B(x,w)}. Then by the 
definition of 7" quasi in (10) it follows that 

(uj, Vi) G r2j(x"*) n Bi(xi,w; x _i ) <^ (ui,x-\vi) G .F quasi f]B(x,w). 

Thus, in (14) put x' = (ui, x~ l ),w' = Vi to get 

7r(x) + h(x, w) < ir(ui,x~ z ) + h(ui,x~ l , v{) V(uj, v {) G Qi(x~' 1 ) n Bi(xi,w; x~ % ). 

Then employing (7), we get 

<Pi(x,w) < (pi(ui,x~\vi), V (ui,Vi) G tti(x~ l ) nBiixi,™^" 1 ). 

In other words, (xi,w) is a local minimizer of Lj(x _l ). This holds for each i G J\f, whereby (x,y) where 
y = (w, . . . , w) is a local Nash equilibrium. ■ 

Remark : For sake for brevity we have chosen to focus only on the Nash B-stationary points and 
local Nash equilibria. Similar relationships hold also between other notions of stationarity. □ 

3.3 Revisiting the example of Pang and Fukushima [33] 

In 2005, Pang and Fukushima [33] presented an example of a simple multi- leader multi- follower game 
that had no equilibrium. This game has two leaders with objectives (pi and (f2, defined as follows: 

Vl(aJi,yi) = \xi + Vi and ^2(^2, IJ2) = ~ V2- 
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It can be observed that this game is a potential game, but is not a quasi-potential game. However, several 
variants of this game with a modified ip 2 have an equilibrium, since they turn out to be quasi-potential 
games. For example, in a particular variant, the leader objectives are given as follows: 

VifcijZ/i) = \xi + yi and ip 2 (x 2 , IJ2) = ~\x 2 + 2/2, 
and this game has an equilibrium. We discuss the original example and the variants next. 

Example 3.1. Pang and Fukushima [33] Consider a multi-leader multi- follower game comprising of 
two leaders and one follower [33]. Suppose X\ = X 2 = [0, 1] and Y = R. The lone follower is assumed 
to solve the optimization problem 

mm {y{-l + xi + x 2 ) + \y 2 } = max{0, 1 — x\ - x 2 } 
Each leader has an objective function independent of the strategies of the other leader. 



Li(x2) minimize ip± (xi,yi) = \x\ + y\ 
xi, yi 

subject to Xl ^ r « -. t 
yi = maxjU, 1 — X\ — xi) 



\x 2 
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L 2 (xi) minimize f 2 {x 2 ,y 2 ) 

subject to X2 ^ r ^ -, -1 
%)2 = maxjU, 1 — x\ — X2 j 



By substituting for y±, it can be observed that Li(x2) is a convex problem for any x 2 - However L2(xi) 
is not a convex problem and can be rewritten as the following nonsmooth nonconvex program: 



IWxi) minimize min ( — \x 2 , — 1 + x\ — ix 2 ) 
subject to x 2 € [0,1]. 



The resulting reaction maps in the (xi,x 2 ) space are given by the following: 
Ki(x 2 ) = {1 - x 2 } Vx 2 € [0, 1] and n 2 (x 1 ) = < 



'{0} xi G [0,|) 
{0,1} xi = \ 
,{1} X2G(|,0]. 



It is easy to see 1Z 2 is not upper semicontinuous and that 1Z has no fixed point. Thus, this game has no 
equilibrium. □ 

Observe that this game admits a potential function in the (x, y) space given readily by: 

7r(x,y) = v?i(xi,yi) + ip 2 (x 2 ,y 2 ) = \x\ + y 1 - \x 2 - y 2 . 

However this game is not a quasi-potential game, since, clearly, one cannot find a function h such 
that h(x,yi) = y± and h(x,y 2 ) = — y 2 to meet the requirement of Definition 3.3. We now consider a 
modification of this example. 

Example 3.2. Quasi-potential variants of Pang and Fukushima [33] Consider the following 
variant of the Pang and Fukushima example: 



Li(x 2 ) minimize <pi(xi, y%) = \x\ + h{yi) 

Zl,£/1 

subject to Xl ^ f . , , 
yi = maxjU, 1 — x\ — X2) 



L 2 (xi) minimize V 9 2 (x 2 ,2/2) = ~\x 2 + h(y 2 ) 

1 ■ , , x 2 G [0,1] 
subject to rv. 1 i 

y 2 = maxjO, 1 — x\ — x 2 }, 
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where h(-) is a continuous function. Notice that the Pang and Fukushima example is not a special 
case of this game. However this game is a quasi-potential game, with quasi-potential function given by 
7r(x) + h(y) = 7}Xi — \x2 + h(y). By Proposition 3.2, a global minimizer of pi uasi is a global equilibrium 
of the <§ ', where p^" 2181 is defined as 



pquasi m i n i m i ze l Xl — L X2 _|_ fo( w 

Xl,X2,U) 

subject to 



w = max{0, 1 — x\ — X2}, 
xi,x 2 G [0,1]. 



Let us consider some special cases of h: 

• Take h(w) = w. In this case, in Li, L2, one may substitute 2/1 and 2/2, resulting in agents problem 
Li,L2 in x\,x 2 , with objectives, 

ipx(xi,X2) = \xi + max{0, 1 - x\ - x 2 }, ^2(^1,^2) = ~\ x \ + max{0, 1 — x\ — x 2 }, 

respectively. Notice that </?i,y?2 are convex in x\ and X2 respectively. Since the feasible regions 
of both problems is compact (they are unit intervals) and the objective is convex and continuous, 
classical results give that this game has an equilibrium. 

• Take h{w) = —w. In this case, again one may substitute for 2/1 > 2/2 in terms of xi,x 2 - The 
resulting problems Li and L2 are nonconvex. Notice that p^ 113 - 81 is equivalent to minimizing 
\x\ — \x2 — max{0, 1 — X\ — X2} over {(x\,X2) : (x\,X2) £ [0,1] 2 }. It can be observed that the 
minimizer of p^ 81 is given by (xi,X2,w) = (0,0,1). To see why the point (xi, 2:2,2/1,2/2) = 
(0,0, 1, 1) is an equilibrium, notice that given X2 = 0,2/2 = the global minimizer of Li(x2,2/2) 
is x\ =0,1/1 = 1. Similarly, with xi = 0, 2/1 = 1, the global minimizer of L2(xi,2/i) is given by 
X2 = 0,2/2 = 1. 

□ 

Thus we have seen that quasi-potentiality is a powerful property that allows one to leverage the 
unique structure of multi-leader multi-follower games to claim existence of equilibria. 



4 Potential games and shared constraint modifications 

In Section 3, we presented existence statements for a class of multi- leader multi- follower games given 
by implicit potential and quasi-potential games. Yet, these cases do not cover all classes of games. In 
this section, we develop a broader result, albeit for a modified version of the problem. We begin by 
making a general observation regarding how a broad a result one may expect. Since we already know of 
instances of simple multi-leader multi-follower games that do not admit equilibria (the example of Pang 
and Fukushima [33] being a case in point), an existence result that applies for all games is unreasonable 
to expect. Considering that a kind of potentiality has been leveraged in the results of Section 3, one may 
hope to extend the theory sufficiently to cover at least potential games. But here too one encounters the 
roadblock observed in the Pang and Fukushima [33] example - this game is a potential game and it does 
not have equilibria. In this section, we consider a modification of the conventional formulation to arrive 
at a related game that has the same objective functions as the original game but a particular constraint 
structure called a shared constraints. We show that if the objective functions admit a potential function, 
the new games with these modifications have equilibria under mild conditions. The resulting formulation 
is weaker in the sense that equilibria of the original game are equilibria of this modified formulation, 
but the converse is not true. 
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4.1 Another look at the Pang and Fukushima example [33] 



To motivate the results of this section, we consider again the example of Pang and Fukushima [33] and 
analyze a modified version of this example that captures the spirit of the modified formulation we make. 
In this section we revert back to the notation Qi(x~ l ,y~ l ) and Lj(x _ *,y _l ). 

Example 4.3. A modified version of the Pang and Fukushima example [33]: As noted in 
Example 3.1, this example is a potential game in the space of (x, y) and does not admit an equilibrium. 
In Example 3.1 we considered variants where the objective of one leader was modified to give a quasi- 
potential game which did admit an equilibrium. Here, we retain the objectives of the original problem 
and instead add constraints, to arrive at new game which is shown to admit an equilibrium. 

Consider the following modification of the Pang and Fukushima example. The key difference is that 
now leader 1 also has an additional constraint, L y 2 = max{0, 1 — x\ — x 2 }\ which in the original problem 
appeared in leader 2's optimization problem. Likewise, leader 2 now has an additional constraint 
l yi = max{0, 1 — xi — £2}', which in the original problem, was in leader l's optimization problem. More 
specifically, 

• both leaders are constrained by both equilibrium constraints; 

• Leader i's problem is parametrized the decisions of rival leaders (denoted by x~ l ) and the other 
leader's conjectures about the follower equilibrium (denoted by y~ 1 )- 



Li(^2) 2/2) minimize 



vi(x\,yi) = tpi + 2/1 

xi G [0, 1] 
subject to y± = max{0, 1 — x\ — X2} 
y 2 = max{0, 1 — x\ - x 2 } 



L2 ( x 1 j 2/ 1 ) minimize 



subject to 



<P2&2, J/2) = 

x 2 € [0, 1] 
j/i = max{0, 1 
y 2 = max{0, 1 



2^2 - 2/2 
xi 

Xl 



x 2 } 
x 2 } 



We claim that ((xi,x 2 ), (2/1,2/2)) = ((0, 1), (0,0)) is an equilibrium of this modified game. To see why 
this is true, observe the objectives of the two leaders at equilibrium. Leader 1 gets 991(0,0) = whereas 
leader 2 gets (f 2 (l, 0) = Leader l's global minimum is and he thus has no incentive to deviate from 
this strategy. Leader 2's strategy set at equilibrium reduces to a singleton containing only his equilibrium 
strategy. This is induced by the presence of leader l's equilibrium constraint in his optimization problem 
(the constraint y\ = max{0, 1— x±,x 2 } is, at equilibrium, equivalent to = max{0, 1 — x 2 }; together with 
the constraint x 2 € [0, 1] this implies x 2 = 1 and y 2 = 0.) We thus see that the additional constraints 
introduced in each leader's problem facilitate the existence of an equilibrium. □ 

Our aim in this section is to generalize the approach adopted in this example. The modified game 
we have considered has the special constraint structure called a shared constraint. Later, it is shown ( 
Theorem 4.3) that a potential game with shared constraints admits an equilibrium under mild conditions. 
Indeed a result analogous to Prop. 3.2 holds: the global minimizers of the potential function over the 
shared constraint are equilibria of this game. In this game, the shared constraint is given by the set 

2/1 = max{0, 1 — x\ — x 2 } 1 
y 2 = max{0, 1 — x\ — x 2 } J 

We will explain the notation J-~ ac in the following sections. The game admits a potential function: 

n(x 1 ,x 2 ,y 1 ,y 2 ) = ViC^ijl/i) + ^2(^2,2/2) = \x\ +2/1- \x 2 - y 2 . 
The global minimizer of ir over J-~ ac is 



(xi,x 2 ,yi,y 2 ) 



( Xl ,x 2 ) G [0,l] 2 ,(2/i,y 2 ) > 0, 



arg min ■kXi + y\ 

(x,y)GJ" ae 



\x 2 



y 2 = ((0,1), (0,0)), 



which is the equilibrium. 
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4.2 Background and modifications leading to a shared-constraint game 

Shared-constraint games were introduced by Rosen [35] as a generalization of the classical Nash game. 
In a shared-constraint game, there exists a set C in the product space of strategies such that the 
constraints faced by the players are as follows: for any player i, and for any tuple of strategies of other 
players (denoted z~ l ), the feasible strategies z% for player i are those that satisfy (zi,z~ l ) G C. In an 
iV-person shared-constraint Nash game with player payoffs denoted by {/i, . . . , /at}, player i solves: 



Hz-') 


minimize 

Zi 


fi{zi;z *) 




subject to 


G C 



An equilibrium z = (z±, . . . , z^) satisfies the following: 

z G C, fi{zi,...,z N )<f i (z 1 ,...,z i ,...,z N ) V Ei s.t. fa, . . . ,Ei, . . . ,z N ) G C, VieM (15) 
Equivalently [17], 2 is an equilibrium if z € r2 c (z) and for all i 

fi(z\, . . . ,Zn) < fi(zi, ...,Z i: ... ,Zn) V Zi G Qf(z~ l ), 

where 

ft c (z) 4 Yl nf(z~ l ) and (a"*) 4 {5 | (^; z" 4 ) G C} . 

i=l 

A more detailed background about shared-constraint games is in Appendix A. The feasible region 
mapping £1 defined in (3) (where H.i(x~ l , y~ l ) is the feasible region of Lj(x _J , y~ 1 )) is a shared constraint 
if Vt has the following structure: for (x, y) in the domain of fi, 

(a,t))efl(i,j) <J=^> (ui,x~\vi,y~ l ) G J" V i G A/". (16) 

(Recall that J 7 was defined in (4) and is the set of fixed points of fi). It is easy to check that this 
condition does not hold in general for the mapping 0, whereby $ is in general not a shared constraint 
game. Multi-leader multi-follower games bear a natural resemblance to shared-constraint games: each 
leader in such a game is constrained by the equilibrium amongst the same set of followers. In fact, 
the i th equilibrium constraints represent the z th leader's conjecture of follower decisions. However, in 
EPEC $ we see that the feasible region mapping defined in (3) is not necessarily a shared constraint 
(i.e. it does not satisfy (16)). We now present a modification of the conventional formulation for which 
the resulting game has shared constraints. 

Modification: Leaders sharing all equilibrium constraints: Consider the formulation in which 
the i th leader solves the following optimization problem. 





minimize 


(pi(xi,yi;x l ) 






iVi 




















subject to 


y% g Yi, 










yj G S(x), 


3 = 1,.. 


.,N. 



We denote this game by c# ae and note that the difference between <# ae and $ is that all constraints 
yj G S(x), j = 1,...,N are now a part of each leader's optimization problem (thus the superscript 
"ae"). In effect, each leader takes into account the conjectures regarding the follower equilibrium made 
by all other leaders. The result is that for any i, yi satisfies the same constraints in problems Lj and 
L ae , but Xi is constrained by additional constraints in L ae . 
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For yj G Yj,Xj G Xj for j ^ i, let f2 ae (x *,y l ) be the feasible region of L ac (x l ,y *) and let 
Q ac , T ac , S N and be denned as 

N 

n™(x,y)±Hnr(x-\y- 1 ), ^^{(x,y) \ (x, y) G ft ac (x, y)}, (17) 

i=i 

N 

S N (x) 4 l[S(x), G 4 {(x,y) [y G S w (x)}, (18) 

where £/ is the graph of S N and J-~ ac is the set of fixed points of S7 ac . An equilibrium of ^ ac is a point 

(x,y)GJ" ae , such that ipi(x i} yc, x~ l ) < ipi(x~i, yf, x~ l ) V (xi,yj) G Q ac (x~ l ,y~ l ),Vi. 

The modification <f ae is weaker than <§ in the sense that an equilibrium of <§ is an equilibrium of <^ >ae , 
as formalized next. 

Proposition 4.1 Consider the multi-leader multi-follower game defined by <§ ae . Then the following 
hold: 

(i) The mapping Q ae (x,y) is a shared constraint mapping satisfying (16); 
(ii) A point (x, y) is a fixed point of f2 ae if and only if it is a fixed point of f2. i.e., J- = J- ae ; 
(Hi) Every equilibrium of S is an equilibrium of <f ae . 
Proof : 

(i) It can be seen that for any i and any x~\ y~ % , where Xj G Xj, yj G Yj for all j ^ i, we have that 

Of (x _i , y-*) = { Xi ,yi | Xi G X ilVi G Y i} Vj G «S(x) for j = 1, . . . , iV} 
= {xi,yi | ^ G Xi,yi G Y~j,y G 5 w (a;)}. 
But yj G Yj, G Xj for j ^ i, implying that 

{xi, yi \ Xi £ Xi, yi £Yi,y G S^x)} = {^i, 2/i I € X i; ^ G Yj for J = 1, . . . , N, y G ^(x)} 

= {xi,yi \ x £ X,y eY,(x,y) e Q}, 
where Q is defined in (18). Thus Q ae is a shared constraint of the form dictated by (16). 

(ii) It suffices to show that T = J 73,0 . But, from (i) it follows that J~ ac = (X x Y) D Q, and it is also 
seen that J- equals (X x Y) V\Q. The result follows. 

(iii) An equilibrium (x,y) of <§ lies in T and thereby in .F ac . Since Vt ac {x~ l ,y~ l ) G f2j(x~ J , y~ l ), the 
result follows. 



A special case of a game S" which is already a shared-constraint game is the following. Consider 
a multi- leader multi- follower game, denoted by $ , in which the leaders solve bilevel optimization 
problems. Specifically, in such a game, the i th leader solves the following parametrized problem: 



L^s-*) 


minimize 


ipi{xi,yi;x l ) 












subject to 


yi G Si(xi), 






Vi G Yi. 
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Since yi G Si(xi), there is no coupling of leader decisions in the constraints of leader problems. This is 
a special case of $ with S{x) = Ilie/V^O 11 *)' w here Si{x) is the solution of a variational inequality for 
each i and where the objective of leader i depends only on the equilibrium of Si(x) and not on Sj(x) 
for j ^ i. With a slight abuse of our notation so far, we let yi denote an element of the set Si{xi) and 
Yi be the space of such y^. Let bl be the feasible region of L bl (rE~', y~ l ) and let F hl be the set of fixed 
points of Q bl = Yli=i Since there is no coupling, it is easily seen that 

^ = n u = {(x,y) \ x e X,y eY,(x,y) e §}, 

where Q = f\f =1 Gi, Y = Y\f =1 Yi, and Qi is the graph of If {xj,yj) G O bl , for j / i, 

= {( x i,Ui) I x i G Xi,yi G Yi,yj G 5i(xj)} = {(aj»,yi) | G J" b1 }. 

It follows that this game is a shared constraint game. 

In the following section we present the existence results for the games <f ae , but since the only property 
we use is the shared constraint structure, our results apply also to <^ bl . 

4.3 Potential games and existence of global equilibria 

We present existence statements for <f ae , the shared constraint variant of multi-leader multi- follower 
models. We emphasize that this formulation is an EPEC - i.e., in this formulation, the optimization 
problem of each leader is indeed constrained by an equilibrium constraint - and it is thus a hard problem 
in its own right. 

The existence results of this section pertain to potential multi-leader multi-follower games [28], which 
were defined in Definition 3.1. If (fi is a continuously differentiable function for i = 1,...,N, then it 
follows [28] that ir is continuously differentiable. In this case it is a potential function if and only if 

Viipi(xi,yi]x~\y~ % ) = Viir(xi,yi;x~\y~ l ) V x,y,V i, (19) 

where Vj = — r. i.e., if and only if the mapping 

F = (Vivi, • • • ; Vjv^iv) (20) 

is integrable. The following lemma follows from a well known characterization of integrable mappings. 

Proposition 4.2 Consider a multi-leader multi-follower game in which the objective functions ipi, i G Af 
of the leaders are continuously differentiable. Then the game is a potential game if and only if for all 
(x, y) G X x Y, the Jacobian VF(x, y) is a symmetric matrix. 

Our main result relates the equilibria of potential multi-leader multi-follower games with shared 
constraints, and the global minimizers of the potential function over the shared constraint, i.e., of the 
following MPEC: 



pae 


minimize 


ir(x,y) 




x,y 




subject to 


(x,y) G J" ae . 



Arguing as we did for J^"^ we find that J- 13,0 is a closed set. 

Theorem 4.3 (Minimizers of P ac and Equilibria of <# ae ) Let <f ae be a potential multi-leader multi- 
follower game with a potential function tt. Then any global minimizer of it over J-~ ac is an equilibrium 
of <f ae . 
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Proof : Let (x,y) G J 73 " be a global minimum of tt over J 7210 . Then, for each i G M 

TT{xi, yi ,x~\ y~ l ) - TT( Ui ,Vi,x~\y- 1 ) < V (u h Vi) : {u i: v h x~\y~ r ) G 7" ac . 

But, (ui,Vi, x~'\ y~ % ) G J-~ ac if and only if (ui,Vi) G Sl ac (x~*, y~ l ), since f2 ae is a shared constraint. Using 
this, together with the fact that tt is a potential function, we obtain that for each i 

tpi{xi,yi; x~\ - <^(u;, «»; x _i , < V (ui, G Q ae (aT\ y _i ). 

This implies that for i = 1, . . . , N, given (x~ l , y~~ l ), the vector (xi,yi) lies in the set of best responses 
for leader i. In other words, (x,y) is an equilibrium of <# ae . ■ 

Having developed a relationship between the minimizers of the potential function and the equilibria 
of multi-leader multi-follower games, it follows that if the minimizer of P ae exists, the game <^ ae admits 
an equilibrium. Following is our existence result for <^ ae . 

Theorem 4.4 (Existence of equilibria of <c? ae ) Let $ &c be a potential multi-leader multi-follower 
game with a potential function tt. Suppose J-~ ac is a nonempty set and (fi(x) is a continuous func- 
tion for i = 1, . . . , N. If the minimizer of P ae exists (for example, if either tt is a coercive function on 
J- ac or if .F ae is compact), then ^ ae admits an equilibrium. 

Proof : It is easy to see from (7) that tt is continuous. By the hypothesis of the theorem, tt achieves its 
global minimum on J ra,e . This could, for instance, be deduced from the coercivity of 7r over a nonempty 
set J-" ae or by the compactness of J 73,6 Based on Theorem 4.3, a global minimizer of tt is an equilibrium 
of (o ac and the result follows. 



Remark : Recall that J-" ac = T . Therefore P ae is essentially a minimization of tx over T . Furthermore, 
note that these results apply also to $ . □ 

All multi-leader multi-follower games when modified to a shared constraint form may not admit 
equilibria. That the leader objectives must admit a potential function is a crucial requirement. If the 
objectives of the leaders are independent of the strategies of other leaders, the sum of the objectives is 
a potential function, whereby any such game is a potential game. We thus have the following corollary. 

Corollary 4.5 Consider a multi-leader multi-follower game $ &e for which J-" ae is nonempty and (fi,i G 
M are continuous. Assume further that for each i G M, (fi(xi,yi;x~ l ) = (pi{xi,yi), i.e., assume that (pi 
is independent of x~ l . If, either the functions (fi,i G M are coercive or if J 73,0 is compact, the game 
has an equilibrium. 

Proof : If ipi(xi,yi;x~ l ) = <pi(xi,yi) for each i, tt = YlieAfPi 1S a potential function. Then by Theorem 
4.3, the game has an equilibrium. ■ 



4.4 Stationary points of the potential function and Nash stationary equilibria 

In general, the global minimization of tt over J 73,0 is hindered by the nonconvexity of J 73,0 as well as 
the possible nonconvexity of tt. When solved computationally, standard nonlinear programming solvers 
may only produce a suitably defined stationary point of P s . Traditionally, while a range of stationarity 
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points are considered in the context of MPECs [36], we focus on two notions - Bouligand stationarity 
and local minimizers of P ac . In this section, we relate these stationary points and local minimizers to 
their equilibrium counterparts in the context of <# ac . Appendix B covers other notions of stationarity. 

Proposition 4.6 (B-Stationary points of P ac and Nash B-stationary points of S ac ) Consider 
the multi-leader multi-follower game $ &c and suppose are continuously differentiate functions 

over X xY that admit a potential function ir. If (x,y) is a B-stationary point o/P ae ; then (x,y) is a 
Nash B-stationary point of <f ae . 

Proof : A stationary point (x, y) of ir over J 73,0 satisfies 

V x ir(x,y) T dx + Vyir(x,y) T dy > 0, V(ds, dy) G T((x, y); P"). (21) 
Fix some i G M and consider an arbitrary (dx^dy^) G T(x{, yf, f2 ae (x _l , y~ 1 ))- By the definition of the 

k k 

tangent cone, there exists a sequence f2 ae (x~ l , y~ % ) 3 (iti,fc, — > (xi,yi) and a sequence < r k — > 
such that Ul,k Th X% — > dx\ and Vl ' k — \ dy' { . It follows that the sequence (Xj^, y i)fc ), where 

Xi,fe = (xi,...,u i)k ,...,x N ), andy ifc = (y u . . . , v i>k , . . . , y N ), (22) 

satisfies (xj^yj/J G J 730 . Therefore, the direction (dxj,dyj where 

dxi = (0, . . . , dx'i, . . . , 0) and dy^ = (0, . . . , dy[, . . . , 0), 

belongs to T(z; J 73,0 ). Substituting (dx,dy) = (dxj,dyj in (21) and using that it is a potential function 
gives 

V Xi V9i(x,y) T dx- + V y ^i{x,y) T dy[ > 0. 
Since, i G M and [dx'^dy'^) G T(xj, yi\ Qf c (x~ l , y~ 1 )) were arbitrary, (x,y) is a Nash B-stationary point 

of(f ae . ■ 



Proposition 4.7 (Local minimum of P ae and local Nash equilibrium) Consider the multi-leader 
multi-follower game <§ &(! with potential function tt. If (x, y) is a local minimum of P ac , then (x, y) is a 
local Nash equilibrium of . 

Proof : The proof is analogous to that of Theorem 4.3. If (x, y) is a local minimum of P ae , there exists 
a neighborhood of (x,y), denoted by B(x,y), such that 

7r(x,y)<n(x',y'), V (x', y') G B(x, y) n J-~ ae . (23) 

Consider an arbitrary i G N and let Bi(xi,yi;x~ l , y~ l ) := {(ui, Vi) \(ui,Vi,x~ l ,y~ l ) G B(x, y)}. Then it 
follows that 

( Ui , Vi ) e (nt c (x-\y- l )nB t (x i ,y i ;x-\y- i )) ( Ui , v u x~\ y-*) G n S(z, y)) . 

Thus, using this relation in (23) and employing (7), we get 

<Pi(x,y) < (fiiiu^vux-^y-*), V (u h Vi) G (^(x^, y _i ) n Bifa, w, x~\ y _i )) . 

In other words, (xi,yi) is a local minimizer of L ac (x _t , y~ l ). This holds for each i G A/", whereby (x,y) 
is a local Nash equilibrium. ■ 
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Remark 4.1. (Relationship to variational equilibria in convex shared constraint games) 

The S ,ae has shared constraints. In the convex setting, the games are typically referred to as generalized 
Nash games and equilibria of such games are referred to as generalized Nash equilibria (GNE). The 
variational equilibrium or VE is referred to as a GNE in which the Lagrange multipliers, corresponding 
to the shared constraints, are equal across players. These multipliers can be interpreted as the shadow 
prices of the associated constraints. Furthermore, when these prices are equal, the equilibria can be 
viewed as corresponding to a uniform auction price while disparities in prices may be a consequence of 
discriminatory prices. The above observations form the basis of a detailed study of the VE and the GNE 
which is the subject of Kulkarni and Shanbhag [24]. There it is shown that under general conditions, if 
a GNE exists a VE also exists, in which case the VE is said to be a refinement of the GNE [37, 4]. 

A VE can also be characterized by the solution of a variational inequality VI(C,.F), where C is the 
shared constraint and for objective functions (p±, . . . , (fN, the mapping F is defined in (20). Now for 
potential games with potential function tt, F = X7tt, whereby VI(C, F) is equivalent to VI(C, Vir). Thus 
in a potential game with shared constraints, every VE is also a stationary point of the potential function 
over the shared constraint. Coming back to the game (o ac , a stationary point of P ae is therefore akin to 
a something like a VE of this formulation. Finally, on a side note, recall that Leyffer and Munson [26] 
also employ consistent multipliers for follower responses in their price consistent formulations. □ 

4.5 Relation between modified and conventional formulations 

In this section, we provide some intuition for the relationship between various equilibria arising from the 
shared constraint modification. We begin by considering a game in which player i has strategies Xi,yi, 
objective fi(xi,yi; x~ l ) and a nonlinear constraint h(x,yi) > 0, where h(-) is concave and fi(xi,yi;x~ t ) 
is convex in Xi,yi, for each x~ l . Specifically, player i solves. 

Ai(x~ l ) minimize fi(xi,yi;x~ l ) 

subject to h(x,yi) > 0. (Ai) 

We refer to this game as G. Suppose Ai(x~ l ) is a convex optimization problem for each x~ l . The shared 
constraint modification of this problem akin to the "ae" formulation is given by the following: 



A ae (x l ,y ^minimize 


fi{ x ii Hi] % ) 

h(x,yi) > 


(An) 


subject to 








h{x,y N ) > 0. 


(Aijv) 



Notice that since h(-) is concave, Af e (x l ,y *) is a convex optimization problem. Denote this game as 
G ae . Our first result relates equilibria of G to that of G ae : 

Proposition 4.8 The point (x, y) is an equilibrium of G with multipliers Ai, . . . , Ajv if and only if (x, y) 
is an equilibrium of G ac with 

Xa = Xi and Ay = 0, Vj / i. (24) 

Proof : By the same logic as in Prop, 4.1 (iii), any equilibrium of G is an equilibrium G ae . Since prob- 
lems Ai,i £ Af, and Af e ,i € J\f, are convex optimization problems, the aggregated KKT conditions of 
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individual players are necessary and sufficient for (x, y) to be an equilibrium of G and G ae , respectively. 
(24) now follows from a examination of the KKT conditions. ■ 



In effect, the multiplier set provides a characterization of the subset of equilibria of G ae that are 
equilibria of G. Naturally, not every equilibrium of G ae will abide by such a requirement; yet, this 
suggests the equilibrium selection problem if one were interested in equilibria of G: 

find (x, y, A) such that the equilibrium conditions hold and Ay = 0, Vi, j, i ^ j. 

This motivates the utility of shared constraint formulations. 

1. Pathways to existence statements: The shared constraint formulation admits a larger set of equi- 
libria, that includes equilibria of the conventional formulation (if they exist). We have seen that 
under mild assumptions, existence of equilibrium akin to variational equilibria can be guaranteed. 
This may be a stepping stone towards developing an approach for claiming existence of equilibria 



2. Tools for equilibrium computation and selection: Equilibrium computation is a crucial concern 
in the design of markets, a realm where such problems routinely arise. Yet, such designs are 
plagued by a key challenge in that equilibria are not readily computable. If the objectives admit 
a potential function, this formulation provides two crucial benefits. First, it allows for computing 
global variational equilibria through the solution of a single optimization problem. Second, if one 
takes the view that the conventional formulation is the "correct" formulation, the modification 
may provide a means to arriving at an equilibrium of the conventional formulation, provided it 
exists. 

5 A hierarchical Cournot game 

In this section, we present a multi-leader multi-follower game from [39] which is a hierarchical Cournot 
game. When formulated in the conventional form it has an equilibrium. Through this game, we will 
demonstrate the validity of Propositions 4.1 and Theorem 4.3. Below, we modify this game in the 
form of ^ ac and show that the claim made in Proposition 4.1 holds: the equilibrium of this game is 
also an equilibrium of its modification. The example also casts light on why existence of equilibria to 
games with shared constraints is more easily guaranteed. The equilibrium conditions of ^ ae have more 
variables, and thus allow for more "degrees of freedom" for their satisfaction. Cournot games, as noted 
in Section 2.1, admit potential functions. We then calculate the minimizer of the potential function of 
this game (i.e., the solution of P ae ) and show that it is an equilibrium of the modified game, thereby 
verifying Theorem 4.3. 

Example 5.4. Let I be a game with N identical leaders and n identical followers. The follower 
strategies conjectured by leader i are denoted by {y{ }/=i n (we use / to index followers) and we let 
y i denote Y2j^fVi- Leader i solves the following parametrized problem: 



of g. 



U{x~\y~ l ) 



minimize 




subject to 



yj = SOL(F(yr 



Xi,x *)), V /, 



Xi > 
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where y{ € R is the conjecture of leader i of the equilibrium strategy of follower /. Follower / solves 
the problem (F(y~f , x)): 



A 2 



minimize 
subject to yf > 0, 



where constants a, b, c are positive real numbers. Since these constants are the same for all followers, 
equilibrium strategies of all followers are equal. Consequently the follower equilibrium tuple conjectured 
by leader i is given by yi = (%,..., fa), where fa satisfies fa <E SOL(F((n-l)fa, x)) (since y~f = (n-l)fa). 
For any x, there is a unique yi that satisfies this relation, given by 



~ _ | (a - bJ2j Xj)/{c + b(n + 1)) if < ^ Sj < 
yi ~ \0 if E^i>«A 

By considering only the first of above cases in (25), we get a restricted game where leader i solves 



(25) 



mx-\y~ i ) 



minimize 



1 2 

2 CX i 



X i 



Hi ~ c+b(n+l) ' 
subject to Ylj x j<a/b, 

Xi > 0. 



b [ x i + Ylj^i Xj+nfa 

: \ 
■ P>i 



This is a generalized Nash game with coupled but not shared constraints. However, since the opti- 
mization problems of the leaders are convex (this is not obvious; see [39, Lemma 1] for a proof), we 
may use the first-order KKT conditions to derive an equilibrium. Let Aj be the Lagrange multiplier 

c +b^n+i) " • ^ ne equilibrium conditions of this game are 



corresponding the constraint "fa 



< Xi _L (c + b) Xi - a + b J ^ xj + nfa J + 



c + 6(n + 1 



A, + /i, > 0, 



y * c + b(n + iy 

< /Zj _L a/6 — > 0, 

j 

= n&Xj + Aj. 



(26) 



We can verify that the tuple x = x* where all leaders play the same strategy x, i.e. x* = x for all i with 
x given by 

_ _ a(b + c) 

X = b(b + c)(JV + 1) + c(6 + c) + 6cn ' 

satisfies equilibrium conditions for the restricted game {L.}j 6 _/v\ The optimal Lagrange multiplier is 
given by A* = —nbx*, p,* = 0. It can then be verified that this equilibrium also satisfies the requirement 
x* < a/b, whereby it is an equilibrium of the original game. The other case of yi = does not result 
in an equilibrium that satisfies X^i x « > a / b -> an< ^ consequently x* is the only equilibrium. 
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Verifying Proposition 4.1 (An equilibria of 

this game modified as <^ ae . 



is an equilibrium of £ ac ): Let us now consider 



Lf(x- i ,y- i ) 



minimize 
subject to 



1 2 

2 CX i 

f 

n = 

Xi > 0. 



- Xi(a 

SOL(F(y- f ,x k ,x- k )), V/,Vft = l, 



.,iV 



Notice that the equilibrium constraint is now for all / and for all k. For any k, the equilibrium constraint 
may be simplified using (25), giving an equation in It is easy to check that this game also admits no 
equilibrium with Ej x j > a /b- Thus, this game is equivalent to the game where Ej ^ s constrained 
to be in [0, a/6]. For such values of . Xj, the first case of (25) applies, and it gives us a game where 
leader i solves 



Lf(x- 4 ,r') 


minimize 


1 2 




a — b 




+ Ej^i x j + "ft) 








Vk 




a-6E. 7 - 


Xj 


:A*, k = l,. 


..,N 




subject to 




c+fe(n4 


1) ' 




Ei xj 


< 


a/6, 


■ Hi, 








X I 


> 0. 

























This is a generalized Nash game with (convex) shared constraints and convex optimization problems 



for leaders. Let A^ be the Lagrange multiplier corresponding to the constraint "y^ 



in the 



c+fe(n+l) 

problem L». The equilibrium conditions for the generalized Nash equilibrium (see [24]) of this game are 



< Xi _L (6 + c)xi — a + 6 x j + nyi + 



JV 



c + 6(n + 1) 4-f 

J= i 



2/j 



a - b^jXj 



> V i € A/". 



(27) 



c + 6(n + l) 

< ^ _L a/6 — > 0, 

j 

= nbxi + A-, 

Notice that the Lagrange multipliers A] for j ^ i are unconstrained barring their presence in the first 
condition of (27). Comparing (27) and (26), we see that if X*,x* solve system (26), then x = x* and 
\\ = A*I{ J= j} for all i,j S W gives a solution to system (27). Consequently, an equilibrium of the 
original game £ is an equilibrium of £ a,c . We have thereby verified Proposition 4.1 for this problem. 

The presence of surplus Lagrange multipliers provides us with more variables than the number of 
equations, whereby existence of solutions is easier to guarantee. An equilibrium of £ is an equilibrium of 
the modified game £ as with a specific configuration of the vector of Lagrange multipliers. Consequently, 
if an equilibrium exists to £ ae , there is no guarantee that there exists one to the original game £ '. 



Verifying Theorem 4.3 (Global minimizer of it is an equilibrium of £ ac ): Applying the same 



arguments as before, we can effectively consider the strategies of leader i in game £ a 
Further, suppose the function ir is given by 



as Xi and tji. 



tt(x, y) 



'^2 x i - a^Xi + b 




+ nb^2 



XiUi 
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where y = (y±, . . . , yjv)- Notice that the map F (cf., Lemma 4.2) is given by 



F(x,y) 




(b + c)xi - a + bl^-Xj + ny 



'3 

nbxi 



and that V7r = i 7 , whereby tt is a potential function for <f ae . The set J- ae for this game is 

jr ae = {(x,y) | x > 0, & satisfies (25) V i}. 

We now determine the global minimizer of tt over .F ae . A significant difficulty in characterizing the 
global minimizer of tt is that tt is not necessarily convex (despite the convexity of the objectives of 
leaders in their own variables). 

We argue as follows. By membership of (x,y) in F ac , we either have % = c+ ^ 3 + -^ for all i or we 
have yj = for all i. Substituting for y, we can write tt as a function only of x (with a slight abuse of 
notation) 



ir(x) 



\c xf -aJ2i.Xi + b fei A + Ei<j + n KS+i) Ei ^ if ^ E* x « ^ 

i c Et x ? - a E» a* + b (Ei ^ 2 + Ei<i if Ei ^ > a / b - 



By symmetry, the values Xi that minimize 7r are equal for all i. Let x% = x' for all % be the minimizer. 
Then, 

f i^cx' 2 - aAV + 6 (Vx /2 + ^J^x' 2 ) + nb^0^Nx' if < x' < a/(Nb), 
) ~ \ ^cx' 2 - aA^x' + 6 (a^x' 2 + ^^x ,2 j if x' > a/(Nb). 

The right hand derivative of tt at x' = a/b is positive, Vir{x') + \ x i =a / b = N\^fe — a + a(N + 1)] > 0. 
Furthermore tt is increasing and coercive for x' > a/(Nb), and consequently the minimizer of tt lies in 
[0,a/(Nb)]. Since x' is a global minimizer of tt, x' necessarily satisfies the first-order KKT conditions 
for the minimization of tt over [0, a/{Nb)\. 

< x< _L N ( (b + c)x' - a + bNx' + nb - "f,^^ + m' > 0, (28) 

\ c + b(n + l) c + b(n + l)J 

< // _L a/(iV6) - x' > 0, 

where // is the Lagrange multiplier for the constraint l a/(Nb) — x' > 0'. If x', // is a solution of system 
(28), then Xj = x', m = y! and X\ = —nbxj = —nbx' for all i,j G M, solves system (27) for the 
equilibrium of S ae . Consequently x = (x', . . . ,x') is an equilibrium of S ae . This verifies Theorem 4.3. 

It should be emphasized that we have claimed that a solution to the concatenated first-order KKT 
conditions of the minimization of tt over F 30 is a global equilibrium of <o' ae : , a claim that is valid because 
the leader problems in <§ ae have been reduced to convex problems. In the case where <S is single-valued 
(as it was in this example), this is possible because we could argue that for values (x,y) of interest, the 
equation y = 5(x) is linear in x, y. □ 



6 Conclusions 

In this paper, we considered a multi-leader multi-follower game and examined the existence of a global 
equilibrium. A standard approach requires ascertaining when the reaction map admits fixed points. 
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However, this avenue has several hindrances, an important one being the lack of continuity in the 
solution set associated with the equilibrium constraints capturing the follower equilibrium. 

We observed that these challenges can be circumvented when the leaders objectives admit a poten- 
tiality property. First, we introduced the notion of quasi-potential games where any global minimizer of 
a suitably defined optimization problem is an equilibrium of the game. Second, in more general prob- 
lems we observed that a modified formulation in which each player is constrained by the equilibrium 
constraints of all players contains the equilbria of the original game when this game does indeed admit 
equilibria, Furthermore, this game admits a shared constraint structure. In such a setting, we showed 
that when the leaders' objectives admit a potential function, the set of global minimizers of the potential 
function over the shared constraint are the equilibria of the modified multi-leader multi-follower game. 

In effect, the above results reduced a question of the existence of an equilibrium to that of the 
solvability of an optimization problem, in particular an MPEC. This solvability can be claimed under 
fairly standard conditions that are tractable and verifiable - e.g., coercive objective over a nonempty 
feasible region - and the existence of a global equilibrium was seen to follow. We further showed 
that local minima and B-stationary points of the respective MPECs are local Nash equilibria and 
Nash B-stationary points of the corresponding multi-leader multi-follower game. We concluded with an 
application of our findings on a multi-leader multi-follower symmetric Cournot game. 

Appendices 

A Additional background on shared-constraint games 

Shared constraint games can be extended to coupled constraint games in which the constraints are not 
necessarily shared. In such a game, an equilibrium is a point z such that 

N 

ze n^C*"*). f i (z 1 ,...,z N )<f i (z 1 ,...,z i ,...,z N ) V^efifV), Vie AT. 
i=i 

Here Qf s is any convex-valued set-valued map, not necessarily of the form of a shared constraint. The 
key difference between and il c is that fi c is completely defined by its fixed point set, given by C, 
whereas NS is not. However in both cases, the equilibrium is a point that lies in the fixed point set 
(given by for J7 NS , where Cj is the graph of flf ). The shared-constraint game is a special case 

of this with Cj = Cj = C = C\.Cfc for all i, j, k. 

Shared constraint games arise naturally when players face a common constraint, e.g. in a bandwidth 
sharing game, and are an area of flourishing recent research; see [10, 24]. Less is known in literature about 
coupled constraint games without shared constraint even with convex constraints. On the contrary, much 
has been said about shared constraint games when the common constraint C is convex (see particularly, 
the works of Rosen [35], Facchinei et al. [9], Kulkarni and Shanbhag [24, 25, 23] and Facchinei and Pang 
[13]). Therefore it is tempting to conjecture that in the case where the O is a shared constraint the 
multi- leader multi- follower game will be more amenable to a general theoretical treatment. 

B Other notions of stationarity 

Here we relate other notions of stationarity for P ae with weaker equilibrium notions of ^ ae . 

When the algebraic form of the constraints are available, a strong-stationary point can be defined. 
Let X{ = {xi\ci(xi) > 0},Yi = {yi\di(yi) > 0}, where Ci,di are continuously differ entiable. Let S(x) be 
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the solution of a complementarity problem: yi € S{x) < _L G(yf,x) > 0, and G is R p -valued 

and continuously differentiable. Thus P ae can be written as 



minimize 

x,y 



subject to 



%(x,y) 

Ci(xi) > 
> 

0< yi ±G(y u x) >0 



1,...,N. 



To define the stationarity conditions, we define the relaxed nonlinear program below which requires 
specifying the index sets Xu and Tn for i = 1, . . . , N where T\i,T<n C {1, . . . , p} and XijUl2i = {1, ■ ■ • ,p}- 



pae 
rnlp 



minimize 



subject to 



ir(x,y) 
' Ci( Xi ) > 
di( yi ) > 
[y^ = 0, VjeX^ 
[^,^■ = 0, VjGXi 
[y^ > 0, Vj 6 X H 
{[Giyux^yQ, Vj£l 2l ) 



where denotes the j th component of '•' and 1^,1^ denote the complements of Zu,l2i respectively. 
Further, we refer to the both index sets colllectively as Zj and the collection of index sets . . . ,Xjv} 
by I. Note that in accordance with [15], we define the index sets independent of the point (x,y). We 
may now state the strong stationarity conditions at a particular point (x,y). 

Definition B.l (Strong-stationarity point of P ae ) A point (x,y) € J- ac is a strong stationarity 
point o/P ac if there exist Lagrange multipliers rji, fii, Aj and f3i,i G TV such that the following conditions 
hold: 

N 



V Xi ir(x, y) - V Xl Ci(xi) J rji - ^ \/ x fi{y il x) T (3 k = 



Vi G TV. 



(29) 



k=l 

V yi ir(x,y) - V yi di(yi) T Hi -A — V yi G(yi, x) T fa = 

< rji 1 a(xi) > 
< ^ ± d( yi ) > 
Vi >o, 

G(j/i,x) >0, 
[^•[^(^,^. = 0, Vj 

[y;]; = or [G( yi ,x)]~0, Vj 
«/ x)^ = and [y^ = 0, then [A^-, > 0, Vj. 

Having defined the strong stationarity conditions, we are now in a position to define the second-order 
sufficiency conditions. These assume relevance in defining a local Nash equilibrium; loosely speaking, at a 
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local Nash equilibrium, every agent's decision satisfies the MPEC-second-order sufficiency or the MPEC- 
SOSC conditions, given the decisions of its competitors. Furthermore, corresponding to a stationary 
point of P^ip, we may prescribe an active set A(x,y) such that A(x, y) = {A\{x, y), . . . , Ajy(x, y)}, 

where Ai{x,y) denotes the set of active constraints corresponding to the set of constraints 

Ci(xi) > 
di(yi) > 

M j = o, Vjez^ 

' [G(y i ,x)] j = 0, Vjefh 
[Vi]j > 0, Vj G x u 
^[G{ yi ,x)\. >0, Vjel 2ij 

Suppose Ai(x, y) = {A^(x, y),Af(x, y),A\{x, y)}, where A!-, Af and A\ denote the active sets associated 
with Cj(xj) > 0, diixji) > 0, and the remaining constraints, respectively. The specification of the active 
set allows us to define the critical cone S*(x,y) as 

S*(x, y) 4 | s : s + 0, Vvr(x, y) T s = 0, aj s = 0, j G A(x, y), a] s > 0, j A(x, y)} , (30) 
where aj denotes the constraint gradients of the j th constraint. 

Definition B.2 (Second-order Strong-stationarity point of P ac ) A point (x,y) of the optimiza- 
tion problem P ae is a second-order strong stationary point of P ae if it is a strong stationary point with 
Lagrange multipliers (n, //, A, j3) and s T V^ )2/ £ s > for s G S*(x, y), where S*(x, y) is given by (30) and 
\/ 2 xy L denotes the Hessian of the Lagrangian ofPf^ lp with respect (x,y) evaluated at (x, y, r), fj,, A, /3). 

Next, we provide a formal definition of Nash strong-stationary and Nash second-order strong- 
stationary points of (f ac , which requires defining the critical cone S*(x, y) for each leader i = 1, . . . , N: 

S*(x,y) = Is, : Si ^ 0,Vi(pi(x,y) T Si = 0,a]si = 0, j G Ai(x,y),ajsi > 0, j G" Ai(x,y)\ , (31) 

where Ai(x, y) 2 denotes the active set utilized in defining the relaxed nonlinear program associated with 
L ae (x~ l , y~ l ) and a,- denotes the constraint gradient associated with j th constraint. 

Definition B.3 (Nash strong-stationary and Nash second-order strong-stationary points) A 

point (x, y) G J-" ae is a Nash strong-stationary point of if for i = 1, . . . , N, there exist Lagrange mul- 

2 The active set associated with Prnip is denoted by A while the active set associated with leader i's problems is denoted 
by A- 



28 



tipliers r)i, fii, Xi and j3f, k = 1, . . . , N , such that the following conditions hold: 



V Xi tfi{x, y) - V x% Ci{xi) T r]i - V Xi G(y i5 x) T /3f = 



k=l 



V yi ipi(x, y) - V yi <k{yi) ' m - h - V yi G(yi,x) T f3\ = 



o < fji ± aixi) > o 
< fii ± d( yi ) > o 
y l >o, 

G(vi,x)>0, 
lfii]j[G(yi,x)]j = 0, VkeM,Vj 
or [G( yi ,x)] r Q, Vj 



> ,V» G TV. 



(32) 



[G(yi, x)],- = and [y^ = 0, tfien [Aj]j, > 0, Vfc G TV, Vj, , 

Furthermore, (x, y) is a Nash second-order strong stationary point of £ &c if (x, y) is a Nash strong 
stationary point of £ ae and if for i = 1, . . . , N , sfV x ^ y .£i(x, y)s{ > for Sj G <S*(x, y) where S*(x, y) 
is given by (31), where yi C{ denotes the Hessian of the Lagrangian function of L ae (x - *, y~ % ) with 
respect to (xi,yi) evaluated at (xi,yi,fji,pi,Xi,i3j, . . . ,i3^) if = <# ae or at (x», yi, fji, pi, \, ft) i/ 

^ac g | # md )(f bl } or ^ {xiM^friKluPi) = <? CC - 

Having defined the relevant objects, we now show that a strong-stationary point of P ae is a Nash 
strong-stationary point of (f ae and a second-order strong-stationary point of P ac is a second-order strong- 
stationary point of <§ &e . For i = 1, . . . , N, one may define a corresponding relaxed NLP associated 
with the i th leader's problem, namely Lf e (x~ l , y~ l ), by employing the index sets Zj. These index sets 
are defined using X and are given by 3 Xj = {Zi, . . . ,In}- 

Proposition B.l (Strong stationary points of P ac and Nash strong stationary points of 

Consider the multi-leader multi-follower game with shared constraints S ac . Suppose (x,y) is a strong- 
stationary point of P ae and satisfies (29) with Lagrange multipliers [r]i, Hi,\i, fii)^ =1 - Then (x,y) is a 
Nash strong -stationary point of (f ae and fori = 1,...,N, (x,y) satisfies (32) with Lagrange multipli- 
ers defined as (fji,pi,\i,(Pi) k=1 ) = (j]i, Hi, Xi, (Pk)k=i) Furthermore, if (x,y) is a second-order strong 
stationary point o/P ae with multipliers (jji, fj,i, Xi, ft)j = i, then (x,y) is a Nash second-order strong sta- 
tionary point of (o ac with firm i 's multipliers given by (fji, pi, \, (^f)fcLi) ■ 

Proof : Suppose (x,y) is a strong stationary point P ae , i.e., suppose there exist multipliers r),fj,,X and 
f3 such that for (x,y), system (29) holds. For each kind of <f ae , we show that (x,y) is a Nash strong 
stationary point of <f ac '. One may then construct Lagrange multipliers to satisfy (32). By comparison 
of (29) and (32), we see that (32) admits a solution (x,y) with multipliers fji = rji,pi = jii,Xi = Xi and 
ft fc = /3 k for all i, k. 

Now assume that (x,y) is a second-order strong stationary point of P ac . To show that (x,y) is a 
Nash second-order strong stationary point of <f ae , we construct Lagrange multipliers as above. It is easy 
to see, that by construction, S/ XuVi C = V XuVi £i and V x . yi Li = V x . yi C for all i G M, where Li is the 



The index sets associated with P^i p are denoted by X while the index sets employed for specifying leader i's relaxed 
NLP are denoted by Xi. Note that the cardinality of Xi and Xi differs when considering the relaxed NLPs corresponding 
to since every leader level problem contains equilibrium constraints of all the leaders. 
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Lagrangian of Lf c evaluated at (x, y) and the above constructed Lagrange multipliers. Furthermore, by 
comparing the feasible region of Lf c with J 73,0 , we observe that the active sets of L- 16 can be defined as 

Mx,y) = {Ac(x,y),Af(x,y),At(x,y),...,A e N (x,y)} . 

Given the specification of the active set, we may now define a relaxed NLP corresponding to this 
active set as well as define the corresponding critical cone S*{x,y). To prove the claim, we proceed by 
contradiction. If (x, y) is not a Nash second-order strong stationary point, then for some i G {1, . . . , N}, 
the point (xi, yi) does not satisfy second-order strong stationary conditions, given (x~ l , y~ l ). Then there 
exists a Wi such that Wi G S?(x,y) such that w] V x . y .C*Wi < 0. We may now define w such that 

w = (wi, . . .,W N ), 
where Wj = 0, j ^ i. Since Wi G S*(x,y), it follows that 

= wJ\7 Xim ipi{x,y) = wJV Xij y.ir(x,y). 

By definition of w, it follows that Mv T V X:y 7r(x, y) = 0. From the definition of w and by noting the 
constructions of Ai(x,y), it can be seen that w G S*(x,y). As a consequence, we have that 

> wfVl^XiWi = w T v2^X w. 

But this contradicts the hypothesis that (x, y) is a second-order strong stationary point of P ae and the 
result follows. ■ 



As a final note, it is not entirely necessary to employ the algebraic characterization of the constraints 
in articulating strong stationarity (cf. [14, 18]). For instance, the authors examine the optimality 
conditions of a disjunctive program defined as 



min fix) 

X 

rn 

subject to x G A = Aj 



(33) 



where Aj is a convex polyhedron for i = l,...,m. Such a problem captures most MPEC models 
considered in the research literature. The authors proceed to show that if the generalized Guignard 
constraint qualification and a suitably defined intersection property holds at a local minimizer z, then 
z is a strong stationary point. Note that the definition of strong stationarity relies on using the Frechet 
normal cone associated with Aj rather than the algebraic characterization of the sets. 



References 

[1] B. Allaz and J.-L. Vila. Cournot competition, forward markets and efficiency. Journal of Economic 
Theory, 59. 

[2] T. Alpcan and T. Ba§ar. Distributed algorithms for Nash equilibria of flow control games. Annals 
of Dynamic Games 7 (2003) to appear., 2003. 

[3] K. Arrow and G. Debreu. Existence of an equilibrium for a competitive economy. Econometrica, 
22(3):265~290, July 1954. 



30 



T. Ba§ar and G. Olsder. Dynamic Noncooperative Game Theory. Classics in Applied Mathematics, 
SIAM, Philadelphia, 1999. 

T. Ba§ar. Control and game-theoretic tools for communication networks. Appl. Comput. Math., 
6(2):104-125, 2007. 

J. Cardell, C. Hitt, and W. Hogan. Market power and strategic interaction in electricity networks. 
Resource and Energy Economics, 19(1):109-137, 1997. 

V. DeMiguel and H. Xu. A stochastic multiple-meader Stackelberg model: Analysis, computation, 
and application. Operations Research, 57(5):1220~1235, September 2009. 

J. F. Escobar and A. Jofre. Equilibrium analysis of electricity auctions. Department of Economics 
Stanford University, 2008. 

F. Facchinei, A. Fischer, and V. Piccialli. On generalized Nash games and variational inequalities. 
Operations Research Letters, 35(2): 159-164, March 2007. 

F. Facchinei and C. Kanzow. Generalized Nash equilibrium problems. J^OR: A Quarterly Journal 
of Operations Research, 5(3):173-210, 2007. 

F. Facchinei and J.-S. Pang. Finite-Dimensional Variational Inequalities and Complementarity 
Problems I. Springer, New York, first edition, February 2003. 

F. Facchinei and J.-S. Pang. Finite- dimensional variational inequalities and complementarity prob- 
lems. Vol. I. Springer Series in Operations Research. Springer- Verlag, New York, 2003. 

F. Facchinei and J.-S. Pang. Nash equilibria: The Variational Approach. In Convex Optimization 
in Signal Processing and Communication, chapter 12, pages 443-495. Cambridge University Press, 
Cambridge, 2009. 

M. L. Flegel, C. Kanzow, and J. Outrata. Optimality conditions for disjunctive programs with 
application to mathematical programs with equilibrium constraints. 2007. 

R. Fletcher, S. Leyffer, D. Ralph, and S. Scholtes. Local convergence of SQP methods for math- 
ematical programs with equilibrium constraints. Technical report, Department of Mathematics, 
University of Dundee, UK, Numerical Analysis Report NA/209., 2002. 

R. Green. The electricity contract market in england and wales. The Journal of Industrial Eco- 
nomics, 47(l):pp. 107-124, 1999. 

P. T. Harker. Generalized Nash games and quasi-variational inequalities. European Journal of 
Operational Research, 54(l):81-94, September 1991. 

R. Henrion, J. Outrata, and T. Surowiec. A note on the relation between strong and m-stationarity 
for a class of mathematical programs with equilibrium constraints. Kybernetika, 46(3):423-434, 
2010. 

R. Henrion, J. Outrata, and T. Surowiec. Analysis of m-stationary points to an epec modeling 
oligopolistic competition in an electricity spot market. ESAIM: Control, Optimisation and Calculus 
of Variations, 1(1), 2009. 

B. F. Hobbs, C. B. Metzler, and J.-S. Pang. Strategic gaming analysis for electric power systems: 
An MPEC approach. IEEE Transactions on Power Systems, 15:638-645, 2000. 



31 



[21] X. Hu and D. Ralph. Using EPECs to model bilevel games in restructured electricity markets with 
locational prices. Oper. Res., 55(5):809-827, 2007. 

[22] R. Kamat and S. Oren. Two-settlement systems for electricity markets under network uncertainty 
and market power. Journal of Regulatory Economics, 25(l):5-37, 2004. 

[23] A. A. Kulkarni and U. V. Shanbhag. New insights on generalized nash games with shared con- 
straints: Constrained and variational equilibria. In Decision and Control, 2009 held jointly with the 
2009 28th Chinese Control Conference. CDC/CCC 2009. Proceedings of the 48th IEEE Conference 
on, pages 151-156, dec. 2009. 

[24] A. A. Kulkarni and U. V. Shanbhag. On the variational equilibrium as a refinement of the gener- 
alized Nash equilibrium. Automatica, 48(l):45-55, 2012. 

[25] A. A. Kulkarni and U. V. Shanbhag. Revisiting generalized Nash games and variational inequalities. 
Journal of Optimization Theory and Applications, 154(1):1— 12, 2012. 

[26] S. Leyffer and T. Munson. Solving multi-leader-common- follower games. Optimization Methods 
and Software, 25(4):601-623, 2010. 

[27] Z.-Q. Luo, J.-S. Pang, and D. Ralph. Mathematical Programs with Equilibrium Constraints. Cam- 
bridge University Press, Cambridge, 1996. 

[28] D. Monderer and L. S. Shapley. Potential games. Games and Economic Behavior, 14(1):124-143, 
May 1996. 

[29] F. Murphy and Y. Smeers. On the impact of forward markets on investments in oligopolistic markets 
with reference to electricity. Oper. Res., 58(3):515-528, 2010. Supplementary data available online. 

[30] K. Okuguchi. Expectations and stability in oligopoly models. In Lecture Notes in Economics and 
Mathematical Systems 138. Springer- Verlag, Berlin, 1976. 

[31] J. V. Outrata. A note on a class of equilibrium problems with equilibrium constraints. Kybernetika, 
40(5):585-594, 2004. 

[32] J.-S. . Pang and G. Scutari. Nonconvex games with side constraints. SIAM Journal on Optimization, 
21(4):1491-1522, 2011. 

[33] J.-S. Pang and M. Fukushima. Quasi-variational inequalities, generalized Nash equilibria, and 
multi-leader- follower games. Computational Management Science, 2(l):21-56, 2005. 

[34] J.-S. Pang and M. Fukushima. Complementarity constraint qualifications and simplified B- 
stationarity conditions for mathematical programs with equilibrium constraints. Comput. Optim. 
AppL, 13(1-3):111-136, 1999. 

[35] J. B. Rosen. Existence and uniqueness of equilibrium points for concave iV-person games. Econo- 
metrica, 33(3):520-534, July 1965. 

[36] H. Scheel and S. Scholtes. Mathematical programs with complementarity constraints: Stationarity, 
optimality and sensitivity. Mathematics of Operations Research, 25:1-22, 2000. 

[37] R. Selten. Reexamination of the perfectness concept for equilibrium points in extensive games. 
International Journal of Game Theory, 4(l):25-55, March 1975. 



32 



[38] U. V. Shanbhag, G. Infanger, and P. W. Glynn. A complementarity framework for forward con- 
tracting under uncertainty. Operations Research, 59(810-834), 2011. 

[39] H. D. Sherali. A multiple leader Stackelberg model and analysis. Operations Research, 32(2):390- 
404, March 1984. 

[40] H. D. Sherali, A. L. Soyster, and F. H. Murphy. Stackelberg-Nash-Cournot equilibria: Characteri- 
zations and computations. Operations Research, 31(2):253-276, 1983. 

[41] H. V. Stackelberg. The Theory of Market Economy. Oxford University Press, London, 1952. 

[42] C.-L. Su. Equilibrium Problems with Equilibrium Constraints. PhD thesis, Department of Man- 
agement Science and Engineering (Operations Research), Stanford University, 2005. 

[43] C.-L. Su. Analysis on the forward market equilibrium model. Operations Research Letters, 35(1) :74- 
82, 2007. 

[44] J. Yao, I. Adler, and S. S. Oren. Modeling and computing two-settlement oligopolistic equilibrium 
in a congested electricity network. Oper. Res., 56(l):34-47, 2008. 

[45] H. Yin, U. V. Shanbhag, and P. G. Mehta. Nash equilibrium problems with scaled congestion costs 
and shared constraints. IEEE Trans. Automat. Contr., 56(7):1702-1708, 2011. 



33 



